Autonomous interactive intermediaries : social intelligence for mobile communication agents

Thesis (Ph. D.)--Massachusetts Institute of Technology, School of Architecture and Planning, Program in Media Arts and Sciences, 2005.Includes bibliographical references (p. 151-167).Today's cellphones are passive communication portals. They are neither aware of our conversational settings, nor of the relationship between caller and callee, and often interrupt us at inappropriate times. This thesis is about adding elements of human style social intelligence to our mobile communication devices in order to make them more socially acceptable to both user and local others. I suggest the concept of an Autonomous Interactive Intermediary that assumes the role of an actively mediating party between caller, callee, and co-located people. In order to behave in a socially appropriate way, the Intermediary interrupts with non-verbal cues and attempts to harvest 'residual social intelligence' from the calling party, the called person, the people close by, and its current location. For example, the Intermediary obtains the user's conversational status from a decentralized network of autonomous body-worn sensor nodes. These nodes detect conversational groupings in real time, and provide the Intermediary with the user's conversation size and talk-to-listen ratio. The Intermediary can 'poll' all participants of a face-to-face conversation about the appropriateness of a possible interruption by slightly vibrating their wirelessly actuated finger rings.(cont.) Although the alerted people do not know if it is their own cellphone that is about to interrupt, each of them can veto the interruption anonymously by touching his/her ring. If no one vetoes, the Intermediary may interrupt. A user study showed significantly more vetoes during a collaborative group-focused setting than during a less group oriented setting. The Intermediary is implemented as a both a conversational agent and an animatronic device. The animatronics is a small wireless robotic stuffed animal in the form of a squirrel, bunny, or parrot. The purpose of the embodiment is to employ intuitive non-verbal cues such as gaze and gestures to attract attention, instead of ringing or vibration. Evidence suggests that such subtle yet public alerting by animatronics evokes significantly different reactions than ordinary telephones and are seen as less invasive by others present when we receive phone calls. The Intermediary is also a dual conversational agent that can whisper and listen to the user, and converse with a caller, mediating between them in real time.(cont.) The Intermediary modifies its conversational script depending on caller identity, caller and user choices, and the conversational status of the user. It interrupts and communicates with the user when it is socially appropriate, and may break down a synchronous phone call into chunks of voice instant messages.by Stefan Johannes Walter Marti.Ph.D

Email filtering and mobile delivery

Thesis (S.M.)--Massachusetts Institute of Technology, School of Architecture and Planning, Program in Media Arts and Sciences, 1999.Includes bibliographical references (p. 121-122).This electronic version was submitted by the student author. The certified thesis is available in the Institute Archives and Special Collections.This thesis is about delivering electronic messages. Active Messenger, a software system, makes it easier and more efficient. Today, there are a multitude of communication devices and channels available to exchange messages. However, each of these devices and channels has different capabilities. Additionally, the location of a user is often unknown. Current systems that decide where to send a message in a heterogeneous communication environment are complicated to customize and inefficient. The Active Messenger improves this situation. The Active Messenger is an agent that is capable of taking several steps over time to guarantee the delivery of a message, trying multiple channels and awaiting possible user reactions. It infers the location of the user by looking at her communication history and communication behavior. If a message arrives in the user's inbox, the Active Messenger decides if it is important by looking at user-specified rules, as well as correlating it with recent messages, the user's calendar, and her address book. Depending on the importance of the message and the inferred location of the user, the Active Messenger decides where to send the message, possibly to several devices in turn, monitoring the reactions of the user and the success of the delivery. For example, if a reply comes back shortly after a message is sent to a two-way capable device, the Active Messenger assumes that the user has read the message. If the primary communication device used provides no back-channel information, the Active Messenger infers whether the message has been read by monitoring other channels shortly thereafter. Depending on the status of the sender defined by the user, the Active Messenger may also give feedback to the sender about the user's location and communication behavior. The goal is to make the Active Messenger easily configurable. This thesis shows a first step towards an integration of the available communication channels.by Stefan Johannes Walter Marti.S.M